Papers with RNN-based models
Character-Based Models for Adversarial Phone Extraction: Preventing Human Sex Trafficking (D19-55)
Copied to clipboard
Nathanael Chambers, Timothy Forman, Catherine Griswold, Kevin Lu, Yogaish Khastgir, Stephen Steckler
| Challenge: | Illicit activity on the Web often obscures information between client and seller, such as the seller’s phone number. |
| Approach: | They propose to use a dataset to model adversarial noise in a text extraction system and propose a visual character language model to interpret unseen unicode characters. |
| Outcome: | The proposed model improves number recognition by 89% over a CRF with a CNN and shows that unicode characters can be translated to unicoding. |
A Lexicon-Based Graph Neural Network for Chinese NER (D19-1)
Copied to clipboard
| Challenge: | Chinese named entity recognition models are vulnerable to word ambiguities due to the lack of global semantics and chain structure. |
| Approach: | They propose a lexicon-based graph neural network with global semantics to solve word ambiguities in Chinese named entity recognition (NER) Lexicons are used to construct the graph and provide word-level features. |
| Outcome: | The proposed model improves on four NER datasets on Chinese characters, potential words, and the whole-sentence semantics. |
Attention-based Conditioning Methods for External Knowledge Integration (P19-1)
Copied to clipboard
| Challenge: | Existing approaches for incorporating external knowledge into deep neural networks (RNNs) lexicon features are used to concatenate external information into the input or hidden network layers. |
| Approach: | They propose a method for conditioning external knowledge into RNNs by concatenating a representation of the external information to the input or hidden network layers. |
| Outcome: | The proposed approach improves performance on six benchmark datasets. |
Just Fine-tune Twice: Selective Differential Privacy for Large Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to protect language models from privacy leakage suffer from limited user control and low utility . et al., 2018: a novel framework that achieves SDP for state-of-the-art large transformer-based models. |
| Approach: | They propose a framework that applies differential privacy to large language models . they use redacted in-domain data to fine-tune the model with original in- domain data . |
| Outcome: | The proposed framework achieves strong utility compared to baselines. |
Recurrent Neural Networks with Mixed Hierarchical Structures and EM Algorithm for Natural Language Processing (2022.lrec-1)
Copied to clipboard
| Challenge: | A variety of hierarchical RNN models have been proposed to incorporate hierarchically-based hierarchic information in modeling languages in the literature. |
| Approach: | They propose a latent indicator layer approach to identify and learn hierarchical information and develop an EM algorithm to handle the latent indicators layer in training. |
| Outcome: | The proposed approach outperforms other RNN-based models in document classification tasks. |